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Abstract 

The paper discusses the estimation of a continuous density function of the target 
random field Xi, i € which is contaminated by measurement errors. In partic- 
ular, the observed random field i S is such that l^i = X; + ei, where the 
random error Ci is from a known distribution and independent of the target random 
field. Compared to the existing results, the paper is improved in two directions. 
First, the random vectors in contrast to univariate random variables are investi- 
gated. Second, a random field with a certain spatial interactions instead of i. i. 
d. random variables is studied. Asymptotic normality of the proposed estimator is 
established under appropriate conditions. 
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1 Introduction 



Denote the integer lattice points in the N dimensional Euclidean space by and consider 
a strictly stationary R*^ valued random field Xi, i e Z^. One tries to observe a random 
variable Xi but the observations are contaminated with noise such as measurement errors. 
Hence, one can only observe Yj, the sum of the true random variable Xi and the error 
variable ei, where the true random variable and the error are assumed to be independent. 
The observable random variable is given as Yi = Xi + and one can only observe a 
sample from the convolved density fv = fx * fe- However, we are interested in the 
density fx, so we have to solve a deconvolution problem. There are many different 
approaches in this setting that lead to consistent estimators of fx- The most common 
method is the deconvolving kernel approach introduced by Stefanski and Carroll (1990). 
Fan (1991a) showed that for independent identically distributed (i.i.d.) random variables 
the convergence rate obtained by the deconvolving kernel density estimator is optimal for 
estimating density fx and its derivatives. Fan (1991fe) showed asymptotic normality for 
the deconvolving kernel density estimators. Masry (1993^, 1993;,) studied the convergence 
rate and asymptotic normality of the deconvolving kernel density estimators for stationary 
processes satisfying strongly mixing or p-mixing conditions. Suppose we observe Yi on a 
rectangular region /„ defined by 



The construction of the kernel density estimators is similar to that proposed by Stefanski 
and Carroll (1990) and Masry (19935). Let K be valued smooth kernel density with 
characteristic function (pK and 0^ be the characteristic function of the error variable ei. 
The bandwidth is a sequence of positive numbers such that 6n ^ as n — > oo, which 
means min(ni, ...jUn) — oo. The deconvolving kernel density estimator of fx is 



/„ = {i : i e Z^, 1 < ife < nfc. A; = 1, N}. 



(1.1) 



with 
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The kernel density estimator in (II. ip can also be written as 
with 

" iG/n 

The purpose of the paper is to establish the asymptotic normality of the deconvolving 
kernel density estimators from dependent random fields. Note that the extension is not 
trivial because of the difficulties coming from spatial ordering. 

A point i in will be referred to as a site and written as i = {ii,i2, ^at)- Let S and S' 
be two sets of sites. The Borel a-fields B{S) = 13{{Xi, e-,), i G S) and B{S') = B{{Xi, e;), i G 
S') are the cr-fields generated by the random variables (Xi, ei) with i in, respectively, S and 
S'. Define distance between S and S' as follows: d{S,S') = min((i(i,j) : i G 5,j G S') 
where = ||i— j|| = \J {ii — ji)^ + ... + {iN — JnY- We will assume that (Xi,ei), 

i G satisfies the following mixing condition: There exists a function il){t) | as 
t — oo, such that whenever iS, 5' C Z^, 

a{B{S),B{S')) = sup{\P{AnB)-P{A)P{B)\,AeB{S),B eB{S')} 

< g{C8iTd{S),Caid{S'))^{d{S,S')) (1.2) 

where Card(5) denotes the cardinality of S and g is a symmetric positive function non- 
decreasing in each variable. We assume that g satisfies 

g{n,m) <C{n + m + lY (1.3) 

for some £ with i > 1 and some C > 0. If g = 1, then Xi, i G Z'^ is called strongly 
mixing, which is one of the mixing conditions discussed in Masry (1993a, 1993^). Mixing 
conditions (11. 2p and (II. 3p are satisfied by many spatial models and examples can be found 
in Guyon (1987). In the following proof, C is generic whose values are unimportant and 
may vary from line to line. And if not explicitly stated, the limit in the following is taken 
as n ^ oo. 
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2 Assumptions 



Assumption 2.1 The density ofYi, fy, is continuous. 



Assumption 2.2 The joint density /ij ofYi and Yj exists and satisfies 



|Aj(u,v)-/y(u)/y(v)|<C 



(2.1) 



for a// i 7^ j and for all (u, v) in some neighborhood of (x, x). 
Assumption 2.3 For some f3 > 0, ||t||^'^|0e(t)| ^ B as t oo. 

Remark 2.1 As stated in Fan (1991b), the limiting behavior of the estimator in ( li. ip 
depends heavily on the tail of (pe- Here, we assume the ordinary smoothness of the char- 
acteristic function (f)^. Double exponential. Gamma distribution, and their mixtures are 
examples of this smooth type. 

Assumption 2.4 0ft:(t) vanishes outside [—1, l]*^. 

Remark 2.2 Let K{x) = ^^^f^ for -oo < x < oo, then <pK{t) = (1 - 

In the paper, we assume either algebraically or geometrically decreasing mixing rate of 
target random field and noise random field. 

Assumption 2.5 i) Bandwidth goes to zero not too slow: for some a with < a < 1, 



a) The mixing rate decreases at a polynomial speed: 



lijit) < \t 



e 



for some 6 > N, \t\ —>■ oo. 

Hi) Bandwidth goes to zero not too fast: 



n 



OO. 
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Remark 2.3 (i) and (Hi) in assu'mption \2.5\ implies 9 > N{1 + jjT+T^' 

Assumption 2.6 i) Bandwidth goes to zero not too slow: for some a with < a < 1, 

a) The mixing rate decreases exponentially: 
for some A > 0, |t| oo. 

Hi) Bandwidth goes to zero not too fast: for some 6i > 0, 



Remark 2.4 (i) and (Hi) in assumption \2. 6i implies 6i < ^ — 



1 a 



2 4/3+2 ■ 



In kernel density estimation, it is important to choose the most appropriate bandwidth. 
The estimation would not be useful if the bandwidth is too small or too large. 



3 Preliminaries 

Lemma 3.1 For smooth density K{x.), we have 

^[/n(x)]^/x(x) 

as n OO. 

Proof. Let 0y(t), be the characteristic functions of and Xi respectively and note 

that 4>Y = (px * (pe- 
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□ 



We will need a lemma in Ibragimov and Linnik (1971) or Deo (1973), which is presented 
here for completeness. 

Lemma 3.2 (1) Suppose M.2\) holds. Let Cr{J-') denote the class of J-' -measurable r.v.'s 
X satisfying ||X||, = {E\X\'fl'' < oo. Let X G Cr{B{S)) and Ye Cs{B{S')). Suppose 
1 < r, s, h < oo and r^^ + s^^ + h^^ = 1. Then 

\EXY - EXEY\ < C\\X\\r\\Y\\s{g{Card{S), Card{S'))ilj{d{S,S'))y/^. (3.1) 

(2) For r.v. 's bounded with probability 1, the right-hand side of /IS. 1\) can be replaced by 

Cg{Card{S), Card{S'))ilj{d{S,S')). 

Denote 

fin = jjEg^i——) 

and 

6 = ^^7n(^)-/.„. 

Hence, 

/n(x)-E[/„(x)] = i5:6. 



Lemma 3.3 Suppose the strictly stationary random field (Xi,ei), i G satisfies 
and i\1.3\i . If assumptions \2.1[\2.5\ hold, then 

limn6(^/^+^)^Far(/„(x)) = J ||tf /^V/.(t)Pcit := a^(x). 

Proof. 

n6(,2'3+i)'^Var(/„(x)) 
= 6(^2/3+i)<ivar(ei) 

:= 1^1 + ^2- (3.2) 



Note 

E&n = / ^7n(u)/y (X - 6„u)rfu < C 

Therefore, 

^(2,+i).E2^ - (3.3) 

Note 

= bf'fy{^)Jgl{u)du{l + o{l)) 

= a2(x)(l + o(l)) (3.4) 

Many difficulties arise since points in higher dimensional space N >2 cannot be linearly 
ordered. To deal with this, we divide sites in the rectangular region, /„, into two groups. 
Let = h" and define 

Si = {(i, j) e /„|0 < rf(i,j) < Cn}, 
^2 = {(i, j) e /nM(i, j) > Cn}. 

On one hand, for (i, j) G 5*1, we establish an upper bound for covariance between and 

|Cov(^i,^j)| = \J y"5(n(u)5(n(v)[/ij(x-6nU,X-6„v) - /y(x-6nU)/y(x-6nV)](iU(iv| 

< c 

Hence, 

^~i^{2p+i)d ^ |Cov(6,^j)| <CcK^+i^''^0 (3.5) 

(ij)e5i 

On the other hand, for (i, j) G 5*2, we establish the covariance inequality with an applica- 
tion of lemma [3^ 

icov(6,ej)i < ch-^'%Aim-m 

< C6„(^+^^)'^^(||i-j||) 
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Under assumption 12.51 for sufficiently large n 



(ij)e52 i>Cn 

< Cb-'^c^-'^O. (3.6) 
The proof of the lemma is complete by (13. 2p through (13.31) . (13.41) and (13. 5p . (13. 6p . □ 

Lemma 3.4 Suppose the strictly stationary random field {Xi,e{), i G satisfies ([23) 
and (I i . . // assumptions \2.1\j2.4\ and assumption \2.6[ hold, then 



limne-^^)^Far(/„(x)) = J ||tf ^^/.(t)^^! := a^(x). 

Proof. Under assumption 12. 6^ for sufficiently large n and some Aq < A, 

^-i^(2/3+i)d ^ |Cov(6,ej)| < E ^^"'e-^^ 

< C6„^n-^«^^0 (3.7) 

The convergence follows from an arbitrary choice of C such that AqC > 1 — 26i. 
Following (13.21) with (13. 3p . (13. 4p and (13.50 . (13.70 . the proof of the lemma is complete. □ 



4 Asymptotic normality 



Decompose 



n(/„(x) - E[/„(x)]) = Y: 6 



fc=l...Ar 
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into smaller pieces involving "large'' and "small" blocks. More specifically, consider all 
sums are running over i := (ii, . . . , ijv). 

jk{p+q)+p 
t/(l,n,xj):= Yl ^i' 

ik=jk{p+'l)+^ 
k=l,...,N 

jk{p+q)+p ijN+i){p+q) 
t/(2,n,x,j):= Yl E ^i, 

ik=jk{p+q)+i iN=jN{p+q)+p+i 

k=l,...,N-l 

jkip+q)+P {jJV-l+l)(p+?) jNip+q)+P 

C/(3,n,x,j):= ^ ^ E , 

«fc=jfc(p+?)+l jjv-i=jiV-i(p+9)+P+l 2jv=jiv(p+q)+l 
k=l,...,N-2 

jk(.p+q)+p UN-i+i){p+q) (ijv+i)(p+ij) 
C/(4,n,xJ):= ^ E E , 

ife=jfe(p+5)+l «JV-i=ijv-i(p+g)+P+l jjv=ijv(p+9)+P+l 
fe=l,...,A?"-2 

and so on. Note that 

ijk+i){p+q) jN(p+q)+p 
C/(2^-l,n,x,j):= Yl E 6, 

2fc=jfe(p+'?)+P+l jjv=jjv{p+9)+l 
k=l,...,N-l 

Ofc+l){p+«) 

C/(2^n,x,j):= 6 

ik=jk{p+q)+p+^ 

k=l,...,N 

where p ■= = and q := Qn = n^' with < ^3 < < and £ + 1 < ^1 + ^^3. 

Note I — s> 0. Without loss of generality, assume that, for some integers ri, . . . ,ri^, n = 
(ni, . . . ,njv) is such that rii = ri{p + q), . . . ,1%^ = rjsiip + q)) with r/j — >• 00 for all 
k ^ 1, ■ ■ ■ , N. Let M = n • • • Tat, then n = M(p + q)^ . For each integer 1 < i < 2^, 
define 

r(n,x,i):= ^ C/(i,n,x,j). 
fe=i,...,Ar 

Clearly S*!! = Yllli T{n, x, i). Note that T(n, x, 1) is the sum of the random variables 
over "large" blocks, whereas T(n, x, i), 2 < i < 2^ are sums over "small" blocks. If it is 
not the case that rii = ri{p + q), . . . ,11^- = r^ip + q) for some integers ri, . . . r^r, then an 
additional term ^(n, x, 2-^ + 1), say, containing all the ^i's that are not included in the 



and 
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large or small blocks, can be considered. This term will not change the proof much. The 
general approach consists of showing that, as n ^ oo. 



Qi-.-- 



Eexp[2uT(n, X, 1)] — Eexp[mf/(1, n, x, j) 



ife=o 

k=l,...,N 



0, 



g2 = n-^e+i)'^EK:T(n,x, 

\i=2 

g3:=n-^e+^)' Ef/^(l,n,x,j)^a^(x) 



(4.1) 

(4.2) 
(4.3) 



jk=0 
k=l,...,N 



, (2|3+l)d 

Q, ^ h-'b^^^^'^' E E[[/2(l,n,x,j)/{|[/(l,n,x,j)|>5a(x)n^6- ^ }] ^ (4.4) 



jk=0 
k=l,...,N 



(2/3+l)d 



for every e > 0. The term fi ^ I]j=2 T{n, x, z) is asymptotically negligible by (14.21) . 
The random variables U{1, n, x, j) (with jk = 0, — 1 for k = 1, N) are asymptot- 

1 (20+l)d 

ically mutually independent by (14.11) . The asymptotic normality of n~^bn ^ T(n, x, 1) 



follows from (14.31) and the Lindeberg- Feller condition (14.41) . The arguments are reminis- 
cent of those used by Masry (1986) and Nakhapetyan (1987). 



Proof of (14.11) . Following the proof of Lemma 5.3 in Hallin et al. (2004), we know (14.11) is 
bounded by ^^-R-(t){q) under (11.30 . 



Under assumption 12.51 



n 



(■+1 



P 



-> 0. 



Under assumption 12.61 



n 



N 



■0(g) < Cn^ 
^ 0. 



□ 



Proof of (14. 2 p and (14. 3 p follows from the proof of Lemma [3.31 and our choice of p and q. 
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Proof of dO]). Note 



which imphes 



Therefore 



Note 



For sufficiently large n, 



lo II <c ( II '^''^^^ II < Ch-^" 

\9n\\oo<CJ 

|f/(l,n,x,j)| <Cp^6„(^+i)'^. 



P 



2N 



0. 



n 



Q4 < Ch-^p'V E P[|f/(l,n,x,j)| > £a(x)n56, 



(2/3+l)d 



= 



jfc=0 
fc=l,...,Ar 



□ 



Following the argument above and Lemma 13.11 we have our theorem on the asymptotic 
normality of the deconvolving kernel density estimator. 

Theorem 4.1 Suppose the strictly stationary random field (Xi,ei), i G satisfies ([23) 
and<m^. If assumptions\2J\KMhold and e satisfies 2{l +1-99^) < 29i < 1 - a{e - N) 
for any 61 and 6*3 such that Q < 6^ < ^ , then 

(^L'"^^^')^(/n(x) - /x(x)) ^ iV(0,a2(x)) 

Theorem 4.2 Suppose the strictly stationary random field (Xi,ei), i G satisfies f I i . ^) 
anc? f I i . . // assumptions \2. IV 2.4 and assumption \2.(A hold and \ > ^ + 1 — 9i for some 
61 > 0, then, 

(^(2/3+l)d)i(^^(^) - /;,(X)) ^ iV(0,a2(x)) 
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